Insect-Inspired Flight Control for Unmanned Aerial Vehicles 

Relatively simple sensory and computing systems would generate remarkably effective control in 
flight to allow close-up approach to hard terrain. 
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Flight-control and navigation systems 
inspired by the structure and function of 
the visual system and brain of insects 
have been proposed for a class of devel- 
opmental miniature robotic aircraft 
called “biomorphic flyers” described ear- 
lier in “Development of Biomorphic Fly- 
ers” (NPO-30554), NASA Tech Briefs , Vol. 
28, No. 11 (November 2004), page 54. 
These form a subset of biomorphic ex- 
plorers, which, as reported in several ar- 
ticles in past issues of NASA Tech Briefs 
[“Biomorphic Explorers” (NPO-20142), 
Vol. 22, No. 9 (September 1998), page 
71; “Bio-Inspired Engineering of Explo- 
ration Systems” (NPO-21142), Vol. 27, 
No. 5 (May 2003), page 54; and “Coop- 
erative Lander-Surface/Aerial Mi- 
croflyer Missions for Mars Exploration” 
(NPO-30286), Vol. 28, No. 5 (May 2004), 
page 36], are proposed small robots, 
equipped with microsensors and com- 


munication systems, that would incorpo- 
rate crucial functions of mobility, adapt- 
ability, and even cooperative behavior. 
These functions are inherent to biologi- 
cal organisms but are challenging fron- 
tiers for technical systems. Biomorphic 
flyers could be used on Earth or remote 
planets to explore otherwise difficult or 
impossible to reach sites. An example of 
an exploratory task of search/surveil- 
lance functions currently being tested is 
to obtain high-resolution aerial imagery, 
using a variety of miniaturized elec- 
tronic cameras. 

The control functions to be imple- 
mented by the systems in development 
include holding altitude, avoiding haz- 
ards, following terrain, navigation by ref- 
erence to recognizable terrain features, 
stabilization of flight, and smooth land- 
ing. Flying insects perform these and 
other functions remarkably well, even 


though insect brains contains fewer than 
1CT 4 as many neurons as does the human 
brain. Although most insects have immo- 
bile, fixed-focus eyes and lack stere- 
oscopy (and hence cannot perceive 
depth directly) , they utilize a number of 
ingenious strategies for perceiving, and 
navigating in, three dimensions. Despite 
their lack of stereoscopy, insects infer dis- 
tances to potential obstacles and other 
objects from image motion cues that re- 
sult from their own motions in the envi- 
ronment. The concept of motion of tex- 
ture in images as a source of motion cues 
is denoted generally as the concept of 
optic or optical flow. Computationally, a 
strategy based on optical flow is simpler 
than is stereoscopy for avoiding hazards 
and following terrain. Hence, this strat- 
egy offers the potential to design vision- 
based control computing subsystems that 
would be more compact, would weigh 
less, and would demand less power than 
would subsystems of equivalent capability 
based on a conventional stereoscopic ap- 
proach. 

These control loops for stabilizing at- 
titude and/ or holding altitude would in- 
clude optoelectronic ocelli and would 
be based partly on dragonfly ocelli-sim- 
ple eyes that exist in addition to the bet- 
ter-known compound eyes of insects. In 
many insects the ocelli only detect 
changes in light intensity and have min- 
imal observable effect on flight. In drag- 
onflies, the ocelli play an important role 
in stabilizing attitude with respect to 
dorsal light levels. The control loops to 
be implemented would incorporate ele- 
ments of both dragonfly ocellar func- 
tions and optical flow computation as 
derived from principles observed in 
honeybee flight. 

On Earth, bees use sky polarization pat- 
terns in the ultraviolet part of the spec- 
trum as a direction reference relative to 
the position of the Sun. A robotic direc- 
tion-finding technique based on this con- 
cept is more robust in comparison with a 
simple Sun compass because the ultravio- 
let polarization pattern is distributed 
across the entire sky on Earth and is re- 
dundant and hence can be extrapolated 
from a small region of clear sky in an else- 
where cloudy sky that hides the Sun. 

A bee tends to adjust its flight speed to 
maintain a constant optical flow (that is, 
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Bees Flew Through a Tapered Tunnel in an experiment on how they use visual cues to control flight. 
The bees decelerated as the tunnel narrowed, then accelerated as it widened. The dashed line shows 
the flight-speed profile that one would obtain if the bees were to hold the angular velocity of the im- 
ages of the walls constant at 320° per second. An obvious advantage of regulating flight speed to ob- 
tain constant image speed is that an insect would automatically decelerate to a safer speed to nego- 
tiate a narrow passage. 
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a constant angular velocity of the image 
of the environment) over its compound 
eye (see figure). Consistent with this 
strategy, a bee utilizes the following sim- 
ple control laws when approaching a 
landing site on a flat surface: 

1 . The optical flow of the surface is held 
constant throughout the descent. 

2. Forward speed is held proportional to 
vertical speed throughout the descent. 


This simple combination of control 
laws enables a smooth landing with min- 
imal computation. The forward speed 
and rate of descent are reduced to- 
gether, and are both close to zero at 
touchdown. No knowledge or measure- 
ment of instantaneous speed or height 
above the ground are necessary. This 
combination of control laws can readily 
be modified for a biomorphic flyer, 


which has a nonzero stalling speed. 

This work was done by Sarita Thakoor of 
Caltech for NASA’s Jet Propulsion Labo- 
ratory and by G. Stange, M. Srinivasan, 
and Javaan Chahl of Australian National 
University and Butler Hine and Steven Zor- 
netzer of Ames Research Center for the NASA 
Intelligent Systems Program. Further infor- 
mation is contained in a TSP ( see page 1 ). 
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@ Domain Compilation for Embedded Real-Time Planning 

Robustness is increased at the price of a moderate increase in complexity. 
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A recently conceived approach to au- 
tomated real-time control of the actions 
of a robotic system enables an embed- 
ded real-time planning algorithm to de- 
velop plans that are more robust than 
they would otherwise be, without impos- 
ing an excessive computational burden. 
This approach occupies a middle 
ground between two prior approaches 
known in the art as the universal-plan 
and hybrid approaches. 

Ever since discovering the perfor- 
mance limitations of taking a 
sense-plan-act approach to controlling 
robots, the robotics community has en- 
deavored to follow a behavior-based ap- 
proach in which a behavior includes a 
rapid feedback loop between state esti- 
mation and motor control. Heretofore, 
system architectures following this ap- 
proach have been based, variously, on 
algorithms that implement universal 
plans or algorithms that function as hy- 
brids of planners and executives, tn a 
typical universal-plan case, a set of be- 
haviors is merged into the plan, but the 
system must be restricted to relatively 
small problem domains to avoid having 
to reason about too many states and 
represent them in the plan, tn the hy- 
brid approach, one implements actions 
as small sets of behaviors, each applica- 
ble to a limited set of circumstances. 
Each action is intended to bring the sys- 
tem to a subgoal state. A planning algo- 
rithm is used to string these actions to- 
gether into a sequence to traverse the 
state space from an initial or current 
state to a goal state. The hybrid ap- 
proach works well in a static environ- 
ment, but it is inherently brittle in a dy- 
namic environment because a failure 
can occur when the environment strays 
beyond the region of applicability of 
the current activity. 


tn the present approach, a system can 
vary from the hybrid approach to the 
universal-plan approach, depending on 
a single integer parameter, denoted n, 
which can range from 1 to a maximum 
domain-dependent value of M As illus- 
trated in the figure, n = 1 represents the 
hybrid approach, in which each linked 
action covers a small part of the state 
space of the system. As n increases, the 
portion of state space associated with 
each action and its subgoal grows. When 
n reaches M, coverage extends over the 
full state space, so that the system con- 
tains a universal plan. 

Through incorporation of an embed- 
ded real-time planning algorithm that 
follows this middle-ground approach, a 
hybrid system can be made much more 
robust in a dynamic environment, tn 
such a system, the planning algorithm 
passes the current subgoals (instead of 
activities) to an executive algorithm. 
The executive algorithm then uses the 
real-time planning algorithm to deter- 
mine when to perform which action 
until it determines either that the cur- 
rent subgoals have been reached or that 


they cannot be reached within n steps. If 
the current subgoals have been 
reached, the planning algorithm gives 
new subgoals to the executive algo- 
rithm. If it has been determined that 
the current subgoals cannot be reached, 
the planning algorithm must alter the 
sequence of actions. 

A structure for finding the next step 
on an n or fewer step path to a subgoal 
is called a universal (n) plan. Because 
complexity increases sharply with n, it 
is necessary to choose n small enough 
to avoid an excessive computational 
burden but large enough that it is pos- 
sible to make a universal (n) plan that 
makes the system robust in the sense 
that it can reach each given subgoal 
state from any state in a large region of 
the state space. 

This approach involves utilizing 
knowledge compilation research by im- 
plementing an off-line compiler that 
generates a universal (n) plan from a 
system description. In the first step of a 
two-step process, the system description 
is converted into a logical expression, 
in what is known as a conjunctive nor- 
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